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Introduction 



Some interceptor type missiles as presently formulated possess 
programmed thrust magnitude history with a gimbaled engine to provide 
steering. The present guidance scheme used on these missiles determines 
the steering control and hence the direction of the thrust vector. We 
examine one such missile and answer the question as to whether perfor- 
mance can be improved if we allow a variable thrust magnitude together 
with thrust direction to be controlled by some guidance scheme. 

In order to take the first step in answering this question, two 
trajectory optimization programs were written. These were designed to 
determine optimal histories of thrust magnitude and direction in order 
to obtain minimum time to interception for our missile under given 
scenarios. While the programs are not in a finely tuned state, neverthe- 
less, preliminary results indicate reductions in the time to intercept 
by as much as thirty per cent from that obtained by the present scheme. 

With tuning of the programs it seems reasonable to expect even greater 
improvements and further investigation seems warranted. 

Model 

The missile model used was two dimensional since all test trajectories 
were flown in a horizontal plane. 

Letting the indicated terms have the meaning specified in the 
nomenclature, then the picture of the model is: 
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Figure 1 
Missile Model 
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The differential equations for this model are^^ : 



la) 


y l 


C\l 

>> 

II 


lb) 


y 2 


= TT-FA cos AT - FN „ 
y 5 y 5 1 


lc) 


*3 


II 


Id) 


y 4 


= TT-FA sin AT - FN „ 
y 5 


le) 


y 5 


= - TT 
8050 


where 


i) 


y lf . . . ,y 5 are called state variables since they define the state 



of the missile and TT,AT are called control variables since they control 
the state through the equations 1); ii) FA,FN are functions of the velocity 
vector and the control angle AT. 

The constraints for this problem are 
2a) 0 < TT < 14400.0 

TF 

2b) / TTdt < 38,500 

0 

in which 2a) is a thrust level constraint which says that our thrust must be 
non-negative and is bounded above by 14400 lbs. and 2b) is a condition on the 
amount of fuel used. 

Our task is, given the initial conditions 
3a) y , y 9 , y^ , y A , y, 

0 z o J o q o D 0 

for the missile and 



1 T o’ 



r lT ’ y 

0 



3 V 



3T„ 



for the target, then determine a history of TT, AT in time which 



a) 



Detailed equations are presented in the Appendix 
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yields a minimum for the time of intercept TF. Using the penalty method to 
include the constraint of target impact in the cost function, our cost 
function is then 

4) c = TF + UN[( yi - y 1T ) 2 + (y 3 - y 3T ) 2 ] 

Method of Solution 

A. General Techniques Available 

There are many ways to attack a problem of the type specified 
above. For example; 

a) the classical calculus of variations technique 

b) gradient technique 

c) conjugate gradient technique 

Of these a) is an indirect method, which seeks a trajectory which satisfies 
certain necessary conditions rather than seeking to reduce the cost function 
directly. This method depends upon the choice of the initial values of 
a set of multipliers called adjoint variables which satisfy a certain system 
of differential equations. This choice is often a highly sensitive one and 
instability in attempting to converge to a solution trajectory can result. 

Methods b) and c) are direct methods in that they directly seek to 
minimize the cost function by seeking new trajectories with lower values 
of cost function. All of these methods are based on generating a sequence 
of trajectories which converges to the minimizing one. The gradient 
technique works by linearizing the cost function at each trajectory of 
the sequence developed and iterates to the next trajectory of the sequence 
by changing the controls in the direction opposite to the gradient. The 
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conjugate gradient technique is a step more sophisticated than the gradient 
technique in that it generates new trajectories in its sequence by effectively 
expanding the cost function in a Taylor Series up through the second order, 
thus obtaining a more accurate representation of this function. 

All of these methods together with a number of others were considered 
for the problem at hand and because of greater sureness of convergence 
the conjugate gradient method was selected. 

B. Brief Description of the Conjugate Gradient Technique 

This method is most easily described when discussing the problem 
of minimizing a cost function which is a quadratic function of the N variables 
x^,...,x n . Thus assume that we are given the problem selecting values of 
x^,...,x n in order to obtain a minimum of the quadratic function 
5) c(X) = d + BX + 1/2 X T GX 

where: i) X denotes the vector (x,,...,x ); ii) d denotes a constant and B 

In 

denotes a constant vector; iii) G denotes the matrix of second partial 
derivatives of c. Given a starting point the conjugate gradient method 
computes a sequence of vectors Hq, along which the function c is 

minimized. Thus starting at Xq the method computes a direction which 
depends on the cost function c and the point X^ and determines a value X^ 
which is a minimum of c in that direction. Next, a direction is 

computed at X^ and c is minimized along that direction to produce the point 

The sequence continues in this manner and it can be shown that in the 
absence of round-off, the method will converge to the minimum point in at 
most N iterations (where N is the dimension of the vector X). 
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In general, as in our case, the cost function is not quadratic. The 
procedure then is to approximate the cost function by the first three terms 
of its Taylor Series at each iteration point so that it has the form of a 
quadratic and to develop the directions Ih from those approximations as 
outlined above for the quadratic case. Details of the conjugate gradient 
method as originally developed by Hestenes for linear systems, are in [1] 
and its application to general functions is explained in [2]. Furthermore, 
the technique of conjugate gradients works on more general functions than 
functions of a finite number of variables and one may apply it with some 
modification to functions of an infinite number of variables (see[3]). 

Thus for a cost function which depends upon an infinite number of variables 
as our cost function which depends upon the value of TT and AT at each 
time point, one may use this technique to seek out those values which 
minimize it. 

C. Application of the Conjugate Gradient Technique to Our Problem 

In order to apply the conjugate gradient technique to our problem, 
two computer programs were written. 

The first of these programs was written using the conjugate gradient 
technique for an infinite number of variables as referred to above. This 
program was never fully checked out due to lack of time. 

The second program was written using the conjugate gradient method 
for functions of a finite number of variables as outlined above. Now as 
previously stated, the cost function for our problem depends upon infinite 
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dimensional controls, namely the magnitude TT and direction AT of the thrust 
vector at each time point. However in any computing machine procedure for 
integrating the differential equations for our problem, only values of 
the controls TT and AT at a finite number of time points are used. For 
example, in the simplest type of integration scheme, if the time interval 
is denoted by DT and t Q , t^, • *ty . . are the time points of the 

integration scheme then 

y(t x ) = y(t 0 ) + y(t 0 )-DT 

6) y(t 2 ) = yCt^) + yCtp-DT 

♦ 

y(t. +1 ) “ y(tj) + y(tj)-DT 

# 

# 

y (TF) - y(TF-DT) + y (TF-DT) *DT 

where y,y denote the state variable to be integrated and its derivative and 
TF denotes the final time. In this scheme only the values of TT and AT at 
the time points t^ affect the trajectory. Thus our cost function which 
depends upon y at the final time in turn also depends on the values of TT 
and AT only at these time points. 

Thus, the computer really reduces the infinite dimensional problem 
to a finite dimensional one. Furthermore if we take this into account 
in formulating our model then our numerical optimization scheme which must 
abide by such shortcomings of the computer, will be surer of success. 

This then is the technique used to adapt the finite dimensional 
conjugate gradient method to our problem. The integration scheme selected 
is the one used on already existing trajectory computer programs for the 
missile under consideration and is as follows: 



7 



7 ) 




y^j+i 3 * W + W 01 



V 5 Ct i+1 ) = y 5 ( tj ) + f 5 ( tj ).DT 



where we have denoted by f ± i = 1,...,5 the right hand sides of 1). This 



by using the first two derivatives of position, while integrating the 



vatives of these quantities. 

Besides computation of the cost function at each iteration point, the 

conjugate gradient method requires us also to compute the derivative of 

the cost function with respect to the control variables TT(t^), AT(t^). 

By the chain rule for differentiation, this requires that we first 

differentiate the cost with respect to the state variables at TF and then 

differentiate the state variables at TF with respect to the controls at 

the times t.. The former derivatives are easily formed, however the latter 

J ; 

derivatives are formed sequentially as follows: According to the inte- 

gration scheme 7) forming the derivative of y^(i = 1,...,5) at t^ with 
respect to AT(t^) and TT(tg) yields 



integration scheme essentially integrates the position components y^ and y^ 



velocity components y^, y^ and the mass y,. by using only the first deri- 
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w . 0 

3AT(t Q ) 



HiM - o 

3TT(t Q ) 



i - 1 



5 
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Forming the derivative of at t^ with respect to AT(t^) and TTCt^) yields 



9a) 

3AT(t 1 ) 



W 

8TT(t 1 ) 



and next, forming derivatives with respect to AT(t Q ) yields 



3AT(t Q ) 



W 

3AT(t Q ) 



9f i (t 0 ) 9y j_ (t 0 ) 



j-1 ' y j (t 0 ) 9AT( V 



9 W 

9 A? (t Q ) 



■DT 



3f i (t 0> 

3AT(t Q ) 



•DT i = 2,4,5 



9b) 



9y i (t i } 

3AT(t 0 ) 



9y i (t 0 ) 

3AT(t Q ) 



9f i (t 0 ) 9y i (t o ) 
j-1 9y j (t o ) 9AT(t o> 



l 



9f i (t 0 ) 

3AT(t Q ) 



1 VJ ^V t ^WV] DT' 

3 ii VV MT(t o ) 3AT(t 0 ) J ' 2 



•DT 



9f i^ fc 0^ 9 ^i+l^ t 0^ 

«DT + 



9 AT (t Q ) 



3 AT (t Q ) 



DT 

2 



i = 1,3 



where the last equalities in 9b) result from 9a) and where f^Ct^) means the 
function f evaluated with arguments y(t^), AT(t^), TT(t^). Similar equations 
hold for the derivatives with respect to TT(t^) and TT(tg). Continuing in 
this fashion, then at time t^ we form the derivatives of y^(t^) with respect 
to TT and AT at all time points up through t^. Forming the derivatives 
with respect to AT at all such times, first we set, (as in 9) the derivative 
with respect to AT(t^) 
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Ii^.0 

A T (t t ) 



while for the derivative with respect to AT at the immediately preceeding 
time point t k _^ 



10b) 



3 AT(t k-i ) 3 AT<t k-i ) 



ay i (t k> 

9AT(t k _ 1 ) 



Sf i (t k-1 ) 

3AT(t k _ 1 ) 



• DT + 



9 WVi> 

3AT(t k _ 1 ) 




i = 1,3 



and finally, for the derivative with respect to AT at all other preceeding 
time points t g ,s = 0,1, ...k - 2 



8 y i (t k ) sy i ( Vl> 



9 AT (t ) 

S 



9AT(t 



-1 , y 9f i (t k-l ) 9y 1 (t k-l ) 

} J-l 3y j ( - t k-l ) 8AT <V 



DT 



i = 2,4,5 



10c) 



» y i(t k ) 



3AT(t g ) 



9AT(t 



+ f !VVi! 3 y i (t k-i ) _ 

> + j-1 8y 1 (t k-l > 8AT <V 



5 

+ l 



3f i+l (t k-l ) 



ayjCt^) 



9y l (t k-i } 

9AT(t ) 
s 



DT 

2 



with similar equations holding for the derivative with respect to TT at 
all time points. It is recognized that all derivatives of the state y 
required on the right hand side of 10) have already been formed at previous 
steps in the process. 

This procedure continues until we reach TF and thus obtain the 
required derivatives of final state. 
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Since the cost function also depends upon TF, we are also required to 
form the derivative of the cost with respect to TF, however this presents 
no difficulty. 

Results 

In stating the results of using the above described computer program, 
it is to be noted that there were severe time limitations on this initial 
phase of the project so that only a minimal amount of time was left after 
formulation, development and checkout of the basic computer program. 
Consequently, the results presented herein are preliminary in the sense 
that no "tuning" (such as problem scaling) of the computer program to 
this problem was done. Such tuning will produce better and often very 
significantly better results than the basic program. Nevertheless, the 
results that were obtained indicate significant savings in time over those 
obtained from the presently used guidance scheme. 

The basic missile target scenario that was used had the target at 
20,000 feet initial range. Both missile and target had initial velocity 
of 800 feet per second. The missile heading and target aspect were varied 
as depicted by dashed lines in the figure below. 
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Figure 2 

Basic Missile-Target Scenario 



The results of the conjugate gradient runs together with a comparison 
to the results of the presently used guidance scheme' are presented in the 
table which follows. In addition, plots of some of these comparison 
trajectories are also presented. In each plot is indicated the time of 
intercept with the target. Finally the values of the control variables 
TT and AT at each time point t^ are listed for each plot. The number of 
such time points or equivalently the number of intervals in the integration 
process is arbitrary and was generally selected to give roughly an interval 
of .25 sec for the initial trajectory and time of flight which were used 
to start the program for each case. 
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COMPARISON OF TRAJECTORIES DETERMINED 



o 

CO 



o 
w 
c n 



H 

CU 

W 

O 

Pi 

w 

H 

J3 



g 

M 



CM 



*<r 

CM 



cn 



vo 

vO 



H 

IS 

W 

cn 



w 





00 

1—1 




* 



> 

CM 






CT\ 






CO 






14 



0 

<r 

1 



_( f f- 



COMPARISON OF TRAJECTORIES DETERMINED 



D 

m 




15 



present SCHEME 
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10 [ COMPARISON OF TRAJECTORIES DETERMINED 




History of Thrust Magnitude (lbs.) and 
Direction (Radians) at Each Time Point 



Missile Heading -90 o 
Target Aspect 90 



THRUST USED ANGLE USED 

-4. 605009591450599E-06 4. 723121593980707 



14399.99997933899 
14399.99997969224 
14399,99998002296 
14399.99998032638 
14399.99998060886 
14399.999980874 
14399.99998117321 
14399.99998147072 
14399.99998178906 
14399.99998213868 
14399.99998253284 
14399.99998298858 
14399.99998352771 
14399.99998417795 
14399.9999849742 
-1. 484135400174198E-05 
-1. 387361742331171E-05 
-1. 89 3201954 70 2595E-05 
-1. 201623031575876E-05 
-1. 11259 7441374629E-05 
-1. 026101918646218E-05 
-9 . 42116649 3039155E-06 
-8.606247083233235E-06 
-7. 816116653991806E-06 
-7.050653059250109E-06 
-6. 309 75433914407 3E-06 
-5. 59 3337 34 7902 79 7E-06 
-4. 901336836832315E-06 
-4. 233704898745038E-06 
-3.590410713869574E-06 
-2.971440567082996E-06 
-2 . 3 76 79 812810054 IE-06 
-1. 806505011774549E-06 
-1. 260601661405314E-06 
-7. 3914863539 00189E-07 
-2 . 422284241523421E-07 
0 .3500000000003638 



.3859842903584423 
.3803681117161034 
.3767565214444642 
.3748835541679647 
.3742062958686325 
3739137777922477 
.3716230858999721 
.3662140979628795 
.3611019836883072 
. 3562308881011089 
.3516144227031929 
.3472233046931528 
.3429874251066726 
.3387945142194222 
.3344809309495753 

.3395337541740675 

.3383031815255845 

.3374743729385739 

.336939188427191 

.3366259984016299 

.336487010192663 

.3364904484178623 

.3366156214075165 

.3368497515614064 

.337185911259483 

.3376216675022208 

.3381581899218649 

.3387996661726958 

.3395529221752953 

.3404271763094834 

.341433874412035 

.3425865604473136 

.3439007378455418 

.345393669010457 

.3470840440900813 

.3489914219494018 
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History of Thrust Magnitude (lbs.) and 
Direction (Radians) at Each Time Point 



Missile Heading -90 o 
Target Aspect 180 



THRUST USED ANGLE USED 



-1. 164666815255909E-05 
14399.99998027089 
14399.99998047564 
14399.99998062214 
14399.9999807254 
14399.99998080467 
14399.99998095616 
14399.99998112485 
14399.99998132152 
14399.99998155864 
14399.99998185297 
14399.99998222689 
14399.99998270991 
14399.99998334048 
14399.99998416803 
-1. 566493161176776E-05 
-1.460274935475232E-05 
-1. 357041566137291E-05 
-1. 256871182486963E-05 
-1. 159822829443353E-05 
-1. 06594218704 3155E-05 
-9. 752657448003086E-06 
-8. 878238563914252E-06 
-8. 0364 300220162 77E-06 
-7. 227474929841107E-06 
-6. 451607773021927E-06 
-5. 709064629795342E-06 
-5.000091267843396E-06 
-4. 324949577890757E-06 
-3.683922571868313E-06 
-3. 077043609868248E-06 
-2. 504968690771787E-06 
-1. 968061221118917E-06 
-1. 470174244710638E-06 
-1. 00 712 78760532 39E-06 
-5. 79326339606816E-07 
-1. 871986448563937E-07 
0 0 



4.723242003744533 
6 . 479262294937597E-02 
6. 335285438950643E-02 
6 . 43769096188719E-02 
6. 797136202113957E-02 
7 . 415169752049955E-02 
7.622122700236574E-02 
7. 700876366212161E-02 
7. 828509488296193E-02 
8. 014004 52356 7484E-02 
8.273575855923544E-02 
8. 632825473188248E-02 
9 . 1 31522 395 38089 IE-02 
9 . 832592525874304E-02 
.1083958274495448 

7 . 96950183133419E-02 
7. 59503741967636E-02 
7.30 1455145550678E-02 
7. 0679569748630 7E-02 
6. 8781899 76333292E-02 
6. 7191480 77868842E-02 
6. 5802014459 30516E-02 
6. 452315951794057E-02 
6.327434468444718E-02 
6 . 19 79 75874 1 7582 7E-02 
6 . 0 56412099 550624E-02 
5.894892171735704E-02 
5. 704890571965851E-02 
5.476865053780268E-02 
5. 199917073219558E-02 
4. 869794646464365E-02 
4. 444098055129932E-02 
3. 9 25645 7109952 7E-02 
3. 272654142216548E-02 
2. 621487103644177E-02 
1. 768514541362738E-02 
6. 513313859402577E-03 
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History of Thrust Magnitude (lbs.) and 
Direction (Radians) at Each Time Point 



o 

Missile Heading -45 q 
T arget Aspect 90 

THRUST USED ANGLE USED 



-1.63353040870099E-05 
14399.99995182016 
14399.99995216494 
14399.99995247651 
14399.99995275883 
14399.99995308508 
14399.99995338534 
14399.99995369842 
14399.99995403657 
14399.99995441427 
14399.99995484988 
14399.99995536674 
14399.99995599447 
14399.99995677048 
14399.99995774172 
14399.99995896665 
14399.99996051725 
14399.99996248091 
14399.99996496153 
-3. 360690567644473E-05 
-3.055014234939948E-05 
-2. 761881665880012E-05 
-2. 4813372 71253712E-05 
-2. 213474462303725E-05 
-1. 958432548230329E-05 
-1. 716 39619 5193501E-05 
-1. 4 8759 704121 7111E-05 
-1. 272317324197033E-05 
-1. 070 89 55994 7662 7E-05 
■8. 837348332594896E-06 
-7 . 1131339 78187216E-06 
-5. 541998031254628E-06 
-4. 130724330628648E-06 
-2. 88746200086 722 7E-06 
-1. 822090320944155E-06 
-9 . 46 72 713260790 3E-0 7 
-2 . 764530322192844E-07 
0 .3500000000003638 



4.686448382899316 

3876516777022849 

3832390471804268 

3801851728985935 

3771757452566404 

3712756293081592 

3581180177472189 

3462880488682431 

3348542026327179 

3239179702043936 

3135202020455658 

3036432105026189 

2942186466090938 

2851357111224346 

2762476770389699 

2673758108020489 

2583097067560104 

2488022056680618 

2384328227279375 

.2701896461683151 

.2705728921977258 

.2712376903123615 

.2721725650935123 

.2733844764567251 

.2748939275923527 

.2767326749345042 

.2789430921864316 

.2815787121560207 

.2847057554868285 

.2884056528652088 

.2927787357020200 

.2979494508159629 

.304073678922899 

.3113490206533355 

.3200292054864544 

.3304437549857585 

.3430223498022051 
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History and Thrust Magnitude (lbs.) and 
Direction (Radians) at Each Time Point 



Missile Heading -45 q 
T arget Aspect 180 

THRUST USED ANGLE USED 



1. 367321582005183E-05 
14400.00005733645 -1 

14400.00005555382 -1 

14400.00005378982 -1 

14400.00005200976 -1 

14400.00005010682 -9 

14400.0000481275 7 

14400.0000460542 1 

14400.00004386944 1 

14400.00004155421 2 

14400.00003908793 3 

14400.0000364487 3 

3. 504169887886131E-05 
3. 215485467067173E-05 
2. 9 2826403439 12 17E-05 
2. 642542579467247E-05 
2. 358333612686819E-05 
2. 0 75631875359 62 7E-05 
1. 794418815165447E-05 
1. 514665623229595E-05 
1.236335325271146E-05 
9 . 593842453132146E-06 
6. 837630698889432E-06 
4.094177052457139E-06 
1. 362901359636352E-06 
0 9.999999999990905E 



4.837170084295014 
. 397415958209 399E-02 
. 281514725891007E-02 
. 385445635108004E-02 
•909021660226769E-02 
. 936584067779497E-03 
. 221619234648867E-04 
. 034171363879 729E-02 
. 8 7884 8443514379 E-02 
. 59 39112 88554153E-02 
. 165518097112531E-02 
. 574040945795267E-02 
7. 42664862136405E-02 
8.1668059898296E-02 
8. 757594125588021E-02 
9 . 238318277518468E-02 
9 . 634692870081228E-02 
9 . 962887758792461E-02 
.102316828785256 
.1044341137623111 
.1059400256996459 
.1067222295889411 
.106580729974342 
.1052018906808591 
.1021200558159281 
-02 
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History of Thrust Magnitude (lbs.) and 
Direction 



o 

Missile Heading -45 q 
T arget Aspect 0 



THRUST USED ANGLE USED 



-8. 636091280320598E-06 
14399.99999224112 
14399.99999235387 
14399.99999246009 
14399.99999263668 
14399.9999928314 
14399.99999305048 
14399.99999330091 
14399.99999359178 
14399.99999393462 
14399.99999434359 
14399.99999483552 
14399.99999542933 
-4 . 167844072779003E-06 
-3. 46731233393475E-06 
-2. 809366742004528E-06 
-2. 195648663283228E-06 
-1. 628276506234843E-06 
-1. 10631018930917E-06 
-6. 306300426630698E-07 
-2 . 031446021637576E-07 
0 0 



5.497045771010888 
4 . 874623557450994E-02 
5 . 320166791474908E-02 
6. 068224114497995E-02 
6.58399346371108E-02 
7 . 008778557880289E-02 
7. 45432687 2394256E-02 
7.929779042401483E-02 
8 . 452 70293 6649 252E-02 
9 . 05150492605648E-02 
9 . 7 71095047 9749 9 6E-02 
.1068473379757659 
.1191950730603627 

8.506952862118209E-02 
7 . 810431814077696E-02 
7.048833264681219E-02 
6. 185014095925982E-02 
5. 24025385183512E-02 
4 . 115799875021087E-02 
2 . 712890277855009E-02 
9 . 850414457511216E-03 
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Conclusions and Recommendations 



From the table, the general pattern is that the conjugate gradient 
trajectories have significantly shorter times to intercept for all cases 
with the greatest improvement occurring for the longer duration trajectories 
and the average improvement being around 25%, The general nature of the 
conjugate gradient trajectory is to bum at full throttle for as long as 
possible. It should be noted here that these results represent local 
minimums of the cost function 4) and not global minimums. There are other 
local minimums which may be significantly better than the ones obtained. 
n Tuning ,f of the computer program and more experimentation with our cost 
function, to determine its "hills and valleys," as a function of thrust 
magnitude and direction history will enable us to achieve these. 

The purpose of the initial phase of this project has been accomplished 
in establishing the desirability of considering variable thrust engines in 
conjunction with engine gimbling to provide trajectories with significantly 
improved characteristics. Specifically* from these results the time to 
intercept has been improved, but improvement in other characteristics such 
as fuel used, can also be obtained. Furthermore, numerical results indicate 
that an engine capable only of restarting in flight rather than a continuously 
variable one achieves these improvements. (1) 

It is noted here that this work establishes the presence of improved 
trajectories over the ones presently being used. Such items as mechanization 
of these trajectories into an actual missile have not been considered. 



( 1 ) 

However, this type of control may not provide the global minimum 
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Slices tions 

The following extensions of this work are suggested; 

a) Tuning of the computer program (problem scaling) 

b) Experimentation with additional cases and with the weighting factor 
UN of the cost to determine the best value for reducing the time 

to intercept 

c) Modifying the program to consider minimizing the fuel used till 
intercept or other trajectory parameters of interest 

d) Modifying the computer program to include three dimensional 
trajectories . 
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